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SMALL ENTITY status: 

A. If the status is the same, pay the TOTAL FEE(S) DUE shown 
above. 
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Fee(s) Transmittal and pay the PUBLICATION FEE (if required) 
and twice the amount of the ISSUE FEE shown above, or 
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Determination of Patent Term Adjustment under 35 U.S.C. 154 (b) 

(application filed on or after May 29, 2000) 

The Patent Term Adjustment to date is 678 day(s). If the issue fee is paid on the date that is three months after the 
mailing date of this notice and the patent issues on the Tuesday before the date that is 28 weeks (six and a half 
months) after the mailing date of this notice, the Patent Term Adjustment will be 678 day(s). 

If a Continued Prosecution Application (CPA) was filed in the above-identified application, the filing date that 
determines Patent Term Adjustment is the filing date of the most recent CPA. 

Applicant will be able to obtain more detailed information by accessing the Patent Application Information Retrieval 
(PAIR) WEB site (http://pair.uspto.gov). 

Any questions regarding the Patent Term Extension or Adjustment determination should be directed to the Office of 
Patent Legal Administration at (571)-272-7702. Questions relating to issue and publication fee payments should be 
directed to the Customer Service Center of the Office of Patent Publication at l-(888)-786-0101 or 
(571)-272-4200. 
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~ The MAILING DATE of this communication appears on the cover sheet with the correspondence address- 

All claims being allowable, PROSECUTION ON THE MERITS IS (OR REMAINS) CLOSED in this application. If not included 
herewith (or previously mailed), a Notice of Allowance (PTOL-85) or other appropriate communication will be mailed in due course. THIS 
NOTICE OF ALLOWABILITY IS NOT A GRANT OF PATENT RIGHTS. This application is subject to withdrawal from issue at the initiative 
of the Office or upon petition by the applicant. See 37 CFR 1.313 and MPEP 1308. 

1 . This communication is responsive to 02/04/2008 . 

2. The allowed claim(s) is/are 1,4-20 and 23-54 . 

3. □ Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 

a) □ All b)DSome* c) □ None of the: 

1. □ Certified copies of the priority documents have been received. 

2. □ Certified copies of the priority documents have been received in Application No. . 

3. □ Copies of the certified copies of the priority documents have been received in this national stage application from the 

International Bureau (PCT Rule 17.2(a)). 
* Certified copies not received: . 

Applicant has THREE MONTHS FROM THE "MAILING DATE" of this communication to file a reply complying with the requirements 
noted below. Failure to timely comply will result in ABANDONMENT of this application. 
THIS THREE-MONTH PERIOD IS NOT EXTENDABLE. 

4. □ A SUBSTITUTE OATH OR DECLARATION must be submitted. Note the attached EXAMINER'S AMENDMENT or NOTICE OF 

INFORMAL PATENT APPLICATION (PTO-152) which gives reason(s) why the oath or declaration is deficient. 

5. □ CORRECTED DRAWINGS ( as "replacement sheets") must be submitted. 

(a) □ including changes required by the Notice of Draftsperson's Patent Drawing Review ( PTO-948) attached 

1 ) □ hereto or 2) □ to Paper No./Mail Date . 

(b) □ including changes required by the attached Examiner's Amendment / Comment or in the Office action of 

Paper No./Mail Date . 

Identifying indicia such as the application number (see 37 CFR 1. 84(c)) should be written on the drawings in the front (not the back) of 
each sheet. Replacement sheet(s) should be labeled as such in the header according to 37 CFR 1.121(d). 

6. □ DEPOSIT OF and/or INFORMATION about the deposit of BIOLOGICAL MATERIAL must be submitted. Note the 

attached Examiner's comment regarding REQUIREMENT FOR THE DEPOSIT OF BIOLOGICAL MATERIAL. 



Attachment(s) 

1 . ^ Notice of References Cited (PTO-892) 

2. □ Notice of Draftperson's Patent Drawing Review (PTO-948) 

3. S Information Disclosure Statements (PTO/SB/08), 

Paper No./Mail Date See Continuation Sheet 

4. □ Examiner's Comment Regarding Requirement for Deposit 

of Biological Material 



5. □ Notice of Informal Patent Application 

6. □ Interview Summary (PTO-413), 

Paper No./Mail Date . 

7. ^ Examiner's Amendment/Comment 

8. ^ Examiner's Statement of Reasons for Allowance 

9. □ Other . 
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EXAMINER'S AMENDMENT 

1 . An examiner's amendment to the record appears below. Should the changes 
and/or additions be unacceptable to applicant, an amendment may be filed as provided 
by 37 CFR 1 .312. To ensure consideration of such an amendment, it MUST be 
submitted no later than the payment of the issue fee. 

2. Authorization for this examiner's amendment was given in a telephone interview 
with the Applicant's Attorney (MR. Jeffrey J. Barclay, with Reg. No. 48,950) on 
03/27/2008, without traverse. 

2.1- The claim 20 is amended as the following : 

a software product tangibly embodied in a computer-readable medium, for 
filtering an image including a plurality of pixels, the software product comprising 
instructions operable to cause one or more data processing apparatus to perform 
operations comprising: 

receiving a forward kernel centered at a first pixel in the image, the forward 
kernel assigning forward weights to pixels in a neighborhood surrounding the first pixel; 

specifying a backward kernel centered at a second pixel within the neighborhood 
surrounding the first pixel based on a local attribute of the image at the second pixel, the 
backward kernel assigning backward weights to pixels in a neighborhood surrounding 
the second pixel; 
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determining a first convolution weight of the second pixel based on the backward 
kernel and forward kernel, wherein determining the convolution weight of the second 
pixel includes, 

determining a forward weight assigned to the second pixel by the forward kernel, 
determining a backward weight assigned to the first pixel by the backward kernel, 

and 

using the forward weight and the backward weight to determine the first 
convolution weight of the second pixel by multiplying the forward weight and the 
backward weight; and 

using the first convolution weight and a pixel value of the second pixel to 
generate a new value of the first pixel. 

2.2- The claim 38 is amended as the following : 

A software product tangibly embodied in a machine-readable medium, for depth 
of field filtering an image including a plurality of pixels, the software product comprising 
instructions operable to cause one or more data processing apparatus to perform 
operations comprising: 

specifying a plurality of forward kernels, each of the forward kernels being 
centered at a corresponding center pixel in the plurality of pixels and being based on a 
depth value assigned to the corresponding center pixel; 

for each of the forward kernels, determining convolution weights of neighborhood 
pixels within a neighborhood surrounding the center pixel of the forward kernel, each 
neighborhood pixel's convolution weight being determined based on the forward kernel 



Application/Control Number: 10/767,385 Page 4 

Art Unit: 2624 

and a backward kernel that is centered at the neighborhood pixel and is based on a 
depth value assigned to the neighborhood pixel; and 

blurring the image at each center pixel of the forward kernels using the 
convolution weights and pixel values of the neighborhood pixels within the 
neighborhood surrounding the center pixel. 

Reason for Allowance 

3. The following is an examiner's statement of reasons for allowance: 

Independent claims 1,19, 20, 38, and 39 are allowable over the prior art of 

record. 

Claims 4-18 depend from claim 1 , therefore, are allowable. 
Claims 23-37 depend from claim 20, therefore, are allowable. 
Claims 40-54 depend from claim 39, therefore, are allowable. 

Independent claims 1 , 20, and 39 recite the limitation of:"using the forward weight 
and the backward weight to determine the first convolution weight of the second pixel by 
multiplying the forward weight and the backward weight". 

Independent claims 19 and 38 recite the limitation of: "each neighborhood pixel's 
convolution weight being determined based on the forward kernel and a backward 
kernel that is centered at the neighborhood pixel and is based on a depth value 
assigned to the neighborhood pixel". 
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The closest reference of US 6,728,416 to Gallagher discloses the adjusting of the 
contrast of a digital image with an adaptive recursive filter. The reference of US-PGPUB 
2005/0025378 to Maurer discloses the method for bilateral filtering of digital images. 
However, theses references, either by themselves or by combination with other 
references do not teach the limitation of using the forward weight and the backward 
weight to determine the first convolution weight of the second pixel by multiplying the 
forward weight and the backward weight, and the limitation where each neighborhood 
pixel's convolution weight being determined based on the forward kernel and a 
backward kernel that is centered at the neighborhood pixel and is based on a depth 
value assigned to the neighborhood pixel. 

3. In view of the amended claims and Applicant's Arguments, the rejection to claims 
1, 4-20, 23-38 is expressly withdrawn, and the added claims 39-54 are allowed over the 
prior art of record. 

Any comments considered necessary by applicant must be submitted no later 
than the payment of the issue fee and, to avoid processing delays, should preferably 
accompany the issue fee. Such submissions should be clearly labeled "Comments on 
Statement of Reasons for Allowance." 



Application/Control Number: 10/767,385 Page 6 

Art Unit: 2624 

Contact Information: 

4. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Amara Abdi whose telephone number is (571)270-1670. 
The examiner can normally be reached on Monday through Friday 8:00 Am to 4:00 PM 
E.T.. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Jingge Wu can be reached on (571) 272-7429. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Amara Abdi/ 
Examiner, Art Unit 2624 

/Jingge Wu/ 
Supervisory Patent Examiner, Art Unit 2624 



